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ABSTRACT 

Investigated with six first- to third-grade teachers 
was the generalization of the use of teacher praising and approval 
skills in one. daily instructional period into a second daily 
instructioiiial period. As part of a general investigation of teacher 
management skills by the'Program for Academic Survival Skills, the 
teachers were taught to use contingent approval statements as 
consequences for appropriate student behavior during either the 
reading or math period, and generalization of the level of approvals 
to another class period was evaluated using behavioral observations. 
Results indicated that the trained teachers did significantly improve 
the level of approvals occurring in the gen<^ralization setting; 
however, the effect was only one^third the magnitude produced by the 
*same teachers during the training setting. (Author/IH) . « 
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Abstract ^ 

This frtudy investigated the across setting general ^/ .cion of teacher praising 
and approval skills. Six teachers were taught to use contingent approval • 
statements as consequences for appropriate student behavior in. onedaily in- 
stf^uctional period, e.g., reading or math. The degree to which praising skill 
generalized into a second daily instructional period "was evaluated using behav 
ioral observations. Results indicated that trained teachers did significantly 
improve the level of approvals occurring in the generalization setting; howeve 
the effect v/as only one third the magnitude produced by the same teachers . 
during the training setting. Two control teachers, receiving no training ^ 
showed no improvement in either setting. 



Generalization of Teacher Praising Skills Over Time and Setting: 
What You Teach is What You Get!' 

The study of the general ization of learned behavior has had a historical 
place in education and psychology but only recently has the topic attracted a 
more systematic interest from researchers. o In the last decade, there has been 
an increasing concern with the generalization of skills taught subjects of be- 
havioral interventions in classroom settings (Baer, Wolf, & Risley, 1968; 
J Patterson, McNeal , Hawkins, & Phelps, 1967). Even more recent has been an 
interest in studying the generalized skills of the behavior change agent, e.g., 
classroom teachers (Corte, Wolf, & Locke, 1971; Garcia, 1974; Stokes, Baer, & 
Jackson, 1974). Gladstone and Sherman (1975) demonstrate^f that high school 
students taught to train retarded learners a specific skill could teach a 
different set of skills to other similar subjects without further training- A 
similar generalization effect could be demonstrated if a given teaching skill, 
e.g., the use of'contingent praise for student behavior acquired in one in^s true 
tiqnal setting,* could be demonstrated to carry-over into other instructional 
periods. A recent study by Horton (1975) investigated just such a problem. 
While Horton concluded that no generalization occurred, the data presented in^- 
dicated that for Teacher 1 generalization occurred in the four generalization 
periods. However, there was no systematic effect noted over time. 

The present study sought to examine the effects of training the regular 
classroom teacher to use contingent praise as a consequence for appropriate 
qv oup and individual student behavior. As in the Horton (1975) study, the ' 
degree to which these praising skills, taught in one daily academic instruc- 
tional period and generalized to a second academic period in which the teacher 
was not directly taught or instructed by the trainer, was investigated. The 



study was conducted as part of several generalization investigations of teacher 
management skills ustng a group behavior management program ~ the Program for 
Academic Survival Skills (PASS). PASS (Greenwood, Hops, Delquadri, & Walker, 
Note 1) is a group behavior management program Vor academic related behavior 
(Greenwood, Hops, Delquadri, & Guild, 1974). The program is being developed 
by the Center at Oregon for Research in. the Behavioral Education of the Handi- 
capped (CORBEH). 
Subject Selection - - 

Eight classroom teachers, all female, from three elementary schools, par- 
ticipated in this investigation. The three first, three second, and two third 
grade classes ranged in size from 20-25 pupils each. The schools were located 
in two different school districts in the adjoining Eugene-Springfield, Oregon, 
area (pop. 130,000). teachers were recruited for participation in the study by 
two PASS progVam consultants following a slide presentation^ of the Program for 
Academic Survival Skilts (PASS) tO:the primary, grade teacher. Teachers were re- 
quired to have relatively self-contained classroom units (did not switch children 
or teachers), be responsible for class groups of 20-^30 students, and be willing 
to implement the PASS program during either daily reading or mathematics instruc- 
tional periods. Further, consultant observations of classroom group appropriate 
behavior must have been at least below the 75% level in both reading and math 
periods and teachers' rates of appropriate social consequences had to be below 
.80 per minute. ^ • 

Instructiona l Settings . . 

''The present investigation took place during the daily reading and mathe- 
matics periods scheduled by the teachers in their regular classrooms. Curriculum 
materials over the three schools varied among commonly used curriculum programs. 
Teachers also used their ov/n prepared materials to supplement these primary 



materials. Academic periods ranged in length from 30 to 80 minutes and were 
generally longer in reading tha^.in math^ 60 and 30 mi.nutes respectively. 
In five of the eight classrooms, the daily reading period preceded the math 
•period. 

Design -v. 

The ffrst six teachers meeting the selection requirements were paired by 
grade level: two first, two second, and' two third grade. One set of first, 
second, and third grade teachers (N=3)' were assigned, by toss of coin to be 
trained to implement PASS during their reading period, with their math period 
serving as a generalization baseline period. In counterbalanced fashion, the 
second group was assigned to be trained during their math period with reading 
period constituting the generalization baseline. The twoVemaining teachers 
volunteered as control subjects. and received no formal training throughout the 
investigation. 
Data Collection 

Approximately ly observers were trained to col lect. observation data during 
the reading and math sessions for all eight participating teachers. Observers 
were trained to use an 18-categQry, interval-by-interval recording system allow- 
ing recording of . individual student behavior, teacher behavior, and class <jroup 
behavior. . 

University students and individuals hired from, the community were trained 
as observers in a 5-day v/orkshop using the PASS Observer Training Manual ■ 
(Greenwood, Nicholes, & Hops, Note 2) and videotaped simulations of classroom 
behavior. Observers were trained to an 85% agreement =level on videotape scores 
prior to' observing in the field. 

Observers coded behavior during 5-second interval blocks signaled, by an 
electronic timer clipboard designed for this purpose. Two observers were 



assigned to each classroom session,^. and each observed a different set (N=6) of 
Students once per 60 seconds. Teacher behavior and class group behavior was 
coded once every 10 seconds. Teachers' behavior definitions are presented in 
Table 1 and constituted the major dependent variables in ^ht^^udy. 

* • Insert Table 1 About Here 

______ /' 

Interobserver Agreement 

Agreement checks were made among the 18 observers. To control for agreement 

differences among observer pairs, obser^vers were randomly assigned to partners . 

" ■=> ' ■ . =* 

on a daily basis for agreement checks (Johnson & Bolstad, 1973). Individual 

checks, representing a 5-minute simultaneous observation by two observers, were 

analyzed on an interval-by-interval agreement basis. The percent agreement mean 

for the four teacher behavior codes (# agreements/#agreeme^ ~ + disagreements x 

100)'(N=318 checks) was 93% and ranged from 69 to 100% among checks. ' 

Teacher Training 

Me^etinqs . Experimental teachers were trained to implement the PASS program 
in si:^ 2-hour afterschool meetings as defcribed by Greenwood, Hops, Delquadri/ 
and Guild (1974) and as presented in the PASS Manual for Teachers (Greenwood, 
.Delquadri, Hops, 4 Wal ker , Note 3) . In 2ach meeting, teachers read a prepared 
unit and completed a self-corrected quiz over the material. Next, the teachers 
discussed with their respective consultant the main points in each unit to dem- 
onstrate verbal competency with the concepts. The final part of each meeting 
was devoted to roleplaying of procedures to be implemented in the classroom and 
preparation of materials required- The basic skills covered in each unit were 
(a) Academic Survival Skills Concept, Program-and Previous Results; (b) Speci- 
fying Academic Survival Ski'lls for Your Classroom; (c) Recording Academic 
Survival Skills; (d) Improving Survival Skills with Group Rewards; (e) Using 



Social Reinforcement to Improve Academic Survival Skills; and (f) Maintaining 
the Effects of , PASS and Expanding the Program to Other Instructional Periods.. 

Consultant visits . ' The program consultants assisted the classroom teachers 
.in implementing the .PASS pi?ogram by visiting on a regular basis while the pro- 
gram was established. The consultant was responsible for observing the teacher's 
implementation, answering questions about procedures, and providing feedback to 
"1:he teacher> Specific responsibilities included a.ssistin,i the teacher in intro- 
ducing new program coniponents, e.g., baseline, providing obseVvational agreement 
.chetRs'^wi th the teacher for classroom appropriate behavior as measured by the 
teacher, and providing feedback concerning^ the teacher's use of social conse- 
quences as reinforcers for appropriate* behavior. /After each class had reached 
the 80% appropriate behavso^;; level and the teacher denonstrated a .8-1.0/minute 
or better praise rate, the consultant gradually began removing him/herself from 
the class by attending- every other /iay, every third day, etc>,'^until the teacher 
was in complete control of the program's operation. .. ' 
Procedures 

This study was comprised of three major program phases designed to analyze * 
the eff&cts^.of teacher training duping the full program's operation,, and con- . 
comitant effects in general ization periods, these phases were (a) Baseline, 
(b) Teacher Baseline, and (c) Full ..Program. These procedures were' implemented, 
at a time lag in multiple basel ine fashion in each training period for each 
group of thre6\experimental teachers. 

Basel ine . Data during this phase were collected to assess the operant -lev$l 
of teacher social consequences. No procedures were implemented nor were consul- 
tant visits made to" the^ classrooms during this period. Teacher Training Meetings 
I-ILI occurred after school, 10 days prior to the teacher baseline phase. 



Teacher base! ine , ^ During this phase the consultani and teacher set up the 
PASS clocklight recording instrument, in each teacher'^s experimental Instructional 
period. The clock! ightv recorded the percent of .instructional time that the entire 
class was following the survival skill ruTes (developed in Meeting \\) for appro- 
pnate class behavior.. Students -were instructed oaly that :a new program was 
under way and tITat they would be further informecf within three or four days. 
All other inquiries were ignored.. Teachers .began .using the clocklighfc to estab- 
Vish an operant level for this variable. ' * / ^' 

Ful program . The full progr^tm* was initiated following the fourth and 
fifth teachers' -^leetings dealing with the use of group activity consequences 

and teacher, social consequences to improve student behavior. 

- The students were presented with a list of surviva.1 skills rules which were 
discussed and roleplayed. Next, they -were told that the clocklight operated when 
al 1 were engaged, in the survival skills and stopped when only one student jf/as not.^ 
It was further explaineci that the cla^ss as a group could. earn an acj^ivity if they 
exceeded their baseline average score. Students were al lowed, to select the 
activity for the day by raise of hand and the first session began. " In subsequent 

sessions, the .goal required to earn an activity was established using a schedule 

' ■ . ■ ' - . . * . * \, ' ■ . 

in the program manual. The, schedule increased the "goal ..each day the students 

demonstrated improvement (see 'Greenwood , Delquadri, Hops, & Walker, Note 3, for 
details). Once the class had reached the 80% appropriate behavior level, rewards' 
were *>cheduled to follow several completed 80% periods. The number of periods ■ . 
required increased as goal requirements were achieved and the 80% level was 
maintained. Teachers adjusted goals backwards if failure occurred' at any par- 
ticular level . . 

To implement the procedures, a survival skil Is bulletin board vvas estab- 
lished in each classroom where the rules', group activities, recording sheets 



and a class graph were poste^l. Following* each session, the teacher computed 
the day's score and posted it on the graph for the class to see. 

Prior to the first session using consequences, the consultant di'scus5.ed. 

f ■ ■ 

c 

the teacher's base rate level of appropriatie and inappropriate social conse- 

quences previously recorded by the program consultants during previous phases. 

For appropriate consequences, a goaj of at least I.OO/min was established 

overall with intermediate goals'suggested bv the consultant oh a daily basis. 

In some cases, the consultant used praise cards 'to signal the teacher when to 

praise a student or the»^group during the training s^jssion- Thes'e car*ds were. 

• typical.ly fgded out within the first 5 days of the .program. Following each 

session, the consultant reviewed the number o^praises given by, the teacher 

and graphed, them. In this manner, the teacher could contrast improved praising 

days to previous baseline days, etc.^ Consultants praised teachers for matching 

or exceeding the praising goals agreed upon prior to each session and pointed 

out instances where the teacher's Tnapnropriat^*^nsequence days were low. 

Praise- feedback was designed to , teach new praising tactics and improve the . 

positive atmosphere v/ithin the classtroofli. On days when teachers increased in- 

appropriate/p'raises or fail^'d to reach a^ goal , consultants simply showed the 

■ - 

teacher the graphs, comment^ on what the problem might have been<,'and revised 
the goal for the next day. No fixed progress schedule was established for 
teachers; rather, iv' was worked out by ^ich consultant and teacher team as the 
program progressed. As the. teachers reached and maintained the 1.00 level of 
apprbpriate-consequences,~the consultant beaan decreasing visits and feedback. 



: R esults 
The primary dependent variables in this study were the proportion of in- 
tervals in which teacher approvals or disapprovals were recorded. Table 2 



presents the phase means for each' teacher across settings and phase conditions'' , 
The daily rates of approvals for each teacher are graphically preheated in Figure 1 



Insert figure 1 'and Table 2 About Here 
„ . — ^..„. 



. . -The phase mean levels in Table 2 show that aM eight 'teachers had r*elatively 
low levels of both approval s_.aLnd disapprovals during baseline ranging frorfi .002c 
to .028. In several cases, tea&hers dispensed disapprovals at higher levels ' 
than approvals. Little change was noted-at'the teacher baseline condition when ' 
Teachers 1-6 began recording student bel^avior using the PASS. procedures in the 
training insjtructional setting. Dramatic changes were noted\ however, when the 
full program, including consultant signaling and feedback to teachers, was intro- 
duced for improving priisFe and approval rates. Increases were also noted for *. 
experimental teachers in their generalization settings;. However, -the increases 

were not of the, same magnf tude. as those produced in training. Control . teachers 

^ ■ ■ ■ ' """^ ■" ■ ■ ' 

showed no systematic effecv. in either instructional period.' ; 



Insert Table 3 About Here 



Table 3 summarizes the'phase means for the six expertmental teachers by 

training versus generalization periods. Differences among means using, simple 

t-tests for correlated data "indicated fhat for the training setting a sjg-v 

nifica'nt difference ' (p^^ < .01) w^ noted between both baseline means of .014 and 

.018, respectively, and--the training mean of .075. Next, a smaller effect was 

noted in the. general ization , setting (£< .05); baseline means were .011 and .016, 

respectively, in contrast to a generalization mean of .027." Clearly, the gen- 
' . «• . ' " . ■ ■ ' — - 

eralization effect, while. sighificantly improved from baseline, was only a 

. ■ ■ ■ " ■ • \- 

third't+ie magnitude of thg effect in the training setting (£ < .o/j. ' 



* The teacher use of disapprovals also remained at low levels during^ both 
baseline phases. The introduction .of the PASS program in the trai-fiing settings 
produced slight nonsignificant reductionsvin both settings. The greatest reduc- 
tion (\003) occurnfid in the training setting in contrast to the generalization 
setting (.009, £ < .02). 

bi s,:Cussiori . 

, ft * • • . . 

This study clearly demonstrated that the training of. teacher management . 

procedures in one' academic sett i'pg. generalized to a second setting i;n which" no 

procedures were in effect. The generalization effect was d€mbi;)strated to occur 

o'ndependently of- the* type of- instructional setting, e.g.', .reading' or 'math and 

^ * ' ■ . . . • « ■ " . ^ . 

- to entirely depend upon tl^fe PASS procedures introduced into the training setting. 

■ ' \ ~ • ^ ' . ' ^ ^ ' ' ^ ^ ^ ■ 

The resu>t;n^' generalization^, while conisistent over teachers, was only approxi- 
.'mately one , third the level produced during the trairring .setting. In one case, 
e.g,. Teacher 6,- only increased variability was noted and n6t a systematic, 
stable improvement."" 'these .findings .for across setting generalization effects ' 
appear consistent with the . data reported by- Norton (1975) and, in fact, show, 
somewhat greater effects. , 

The question still remains,* however, as to the functional util ity of , these 
. generalized teacher skiMs. Are they sufficient to produce practical changes 
in student behavior in the ^general i'zation period? If they are not, then a more 
powerful training effect may be required to control student behavior in the 
generalization setting. .'We^ then might concl ude vas did Horton (1975) that effects 
are situation specific and what yoO teach is really. all you. get.- 

. A second question involves delineating those variables in the program re- 
quired to produce'the generalization effect* While ger^^lization of teacher 
behavior; was produced in the present study, it was not possible given the present 
design to ascertain the component variables responsible, for the effects other 



than the full PASS program introduced in the training setting. 

Thirdly,, one may ask what are the minimal original training components re-. 
• quired in J:he generalization period to increase .the magnitude of teacher approval 
to the level produced in the training period? It may be more cost effective to • 
intfroduce sp'Bcific variables less costly than the entire program to increase 
teacher praise rates. Additional- research- will be required to determine precisely 
what those variables are and whether or not it is possible." 



Reference Notes . 

Greenwood, C. R., Hops, H. , Delquadri , J., & Walker, H. M; PASS (program 
for academic survival skills): Manual for consultants . Eugene: Center 
at Oregon for Research in the pehavioral Education of the Handicapped, 
University of Oregon, October 1974. 

Greenwood, C. R. , Nicholes, 'J\ S. , & Hops, H. PASS (program for academic 
survival skills): Observer training manual . Eugene: Center at Oregon for 
Research in the Behavioral Education of the Handicapped, University of 
Oregon, June 1974. 

Greenwood, C. R. , Delquadri, J,, Hops, H. , S Walker, H. M. PASS (program 
for academic survival skills) : Manual for teachers . Eugene: Center at 
Oregon for ResearchM'n the Behayi oral Education of the Hajidicapped, Univer- 
sity of Oregon, October 1974. 




14 



, References * " 

■ • ** " * 

Baer, D. M., Wolf, M. M, , & Risley, T. R. -Some current dimensions of applied 

behavior analysis. Journal of Applied Behavior Analysis , 1968, j^, 91-97. 
Corte, H. E. , Wolf, M. M. , & Locke, B. J.. A comparison of* procedures -for elimi- 
nating self-injurious behavior of retarded adolescents. Journal of Applied 
Behavior Analysis , 1971, 4, 201-213. ' . 
Garcia, E. The training and generalization of a conversational speech <form in 

nonverbal retardates. Journal of Applied Behavior Analysis , 1974, 7_, 137-149. 
Gladstone^ B. W. , ^ Sherman, J. A. Developing generalized behavior modification 
skijls in high school students working with retarded children- Journal of 
Applied Behavior Analysis , 1975,^ 8^, 169-180. 
Greenwood, C. R. , Hops,'H., Delquadri, J., & Giiild,.J. Group contingencies for 
group consequences in classroom management: A.vfurther^ analysis. Journal of 
Applied BehPavior Analysis , 1974, 7, 413-425. 
Norton, G. 0. Gen&ral ization "of teacher behavior as a function of subject matter 
specific discrimination training. Journal of Applied Behavior Analysis , 1975, 
8, 311-319. ; ^ 

Johnson, S. M. , & Bolstad, 0. D. Methodological issues in naturalistic obser- 
vations: Some. problems and solutions for field research. In L. A. Hamerlynck, 
L. C. Handy & E. J. Mash (Eds.), Beh^avior change: Methodology, concepts and 
practice . Champaign, 111,: Research Press, 1973. 
Patterso.1, R., McNeal , S», Hawkins, N., & Phelps, R. Reprogramming the social 

environment. JournaV of Child Psychology and Psychiatry , 1967, 8, 181-195. 
Stokes, T. , 6aer^ D. M. , & Jarcksqn, R. L. Programming the generalization of 
a greeting response in four retarded children • Journal of 'Applied Behavior 
Analysis , 1974, 7, 599-610- 



Definitions of Observationiil Codes 
I. Approval (AP) - included ony combination of: 

A V^Thdl ^=!nPoiVc)l incltJdmn t<.Mcher st<itomentS of nrjise, apDreciaticn, 
or s.^t»sf<KtiCn with the work, conduct, .Utitude, or oerformance of d 
student, group, or cl<iss. 

3 r.o^ttjral approval includina S'-*^ b«»h.wiors 3S smileS, noddinn, wink1nq» 
clapping, making O.K. siqn ^ - "-ners. disnensinn stJrs or tokens, 
etc. 

C. Physical approval includinrj :uch positive nhvsical conduct as hugs, 
patr. , etc. 

AP was not coded '..here tcJchor singly provided feedback- about the correct* 
npss of an acddeniic response unless ncstural or physical approval was included 
" with feedbaci . 



U. Disaoproval (Dl) - included any conhtnation of: 

A. Verbal disapproval including statepu»nts of dislike, dismay, dissa- 
tisfaction, or disnust with work, appearance, or conduct. 

B. Gestural disapproval includinq such beh-Jvior as frowninq. shaking 
the head, shaking a finner. OMnaces, etc. 

C. Physical disapproval includim such negative ohysical conduct as 
hittinq, ^pankinq, puUinn hair of body, pinching, etc. 

Anain» Dl was not coded for feedback Jike "No* that's not correct" unless 
accof^ipanied by gestural or physical- disapproval - 

HI ,Verbal Interactions (VI) - audible statenents directed at the subject or 
' >is qroup were not AP or Dl. This included di scussions , instructions , 
^"or;iconversations between teacher and subject, or subject's group, 

'IV No Response. (fPJ - the teacher was not responding verbally, physically, 
or gpsturally to the class or subject: NR was coded when. the teacher 
was talking to another adult, worked at his or her desk, locked in a 
closet, left room, etc. 
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Table 2 

Phase Means for Teacher (N=8) Social Consequences 
in Experimental, Generalization and Control Conditions 



Teacher 


-JXZ U U 1 M^d . 


Approval 


Disapproval 


Basel ine 


Teacher 
Basel ine 


Full 
Proa ram 


Basel ina 


Teacher 
Baseline 


Full 
Proqram 


1 


Reading 
General ization 


.005 


.010 


. 026 


.020 


.022 


.011 


■ Math 
Experimental 


.004 


.020 


"'. 081 


.011 


.017 


.003 


2 


Reading 
Generalization 


.002 


- .011 


.035 


.011 


.003 


.010 


Math 
Experimental 


.024 


.015 


.064 


.020 


.001 


. 003 


3 


Reading 
Generalization 


.017 


.028 


.033 


.028 


.034 


.016 


Math 
Experimental 


.011 


.018 


. 134 


.032 


. 037 " 


.005 


4 


Reading 
Experimental 


.015 


.017 


.060 


006 


. 006 


.004 


. Math 
Generalization 


. 013 


.005 


.025 


. 006 


. 001 




5 


Reading 
Experimental 


- .013 


.020 


.066 


.014 , 


.007 


.005 


. Math , 
Generalization 


.015 


.025 ' 


.026 


.015 


.012 


. 012" " ' " 


6 


Reading 
Experimejital 


• 013 


.019 


.045 


.005 


.006 


.003 


Math 
General ization 


v015 


. 018 


.022 


.006 


.002 


.007 


7 


Reading 
Control 


.013 


.025 


.008 


.010 


' .015 


.008 


.Math 
/ Control 


.012' 


.021 


.012 ' 


:oo5 


.003 


.007 


8 


Reading 
Control 


\009 


.008 


...010 


.010 


.003 


.004 




Math 
Control 


• 009 


.010 


.009 


.009 


.010 


.007 



,17 



ERIC 



Table 3 

Experimental and Generalization Teachers' (N=6) Behaviors 



Full Program 
(Consultant 
Feedback + 
Teacher Group 
B aseline Baseline Consequences) 

v" prob'. : J orob. ' I 



Experinental .014 (p=ns) .018 (p<.01) .075 
Approvals . prob. (p=ns) (p=r.s) . (p<.01) 

Generalization .011 (p=ns) .016 (p<.05) .027 



Experimental .014 (p=ns) .012 (p=ns) . .003' 
Disapprovals prob. (p=ns) (D£nsJ._____„._.^ (p<^02-)- 



Generalization .014 (p=ns) .014 (p=ns) ,009 
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BASELINE 



FULL PROGRAM 
(Cmsuitonr Feedback and Group Conseq.^ 



READ • GENERALIZATION 
MATM O-O EXPERIMENTAL 





DAYS 



